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PROBLEM TO BE SOLVED: To suppress the waver of the 
display position of a symbol representing an instruction 
position in spite of the waver of the instruction position by a 
user. 

SOLUTION: A situation where an optional place on the 
display surface of a display is instructed by a user is picked 
up from plural directions, an instruction position by the user is 
decided on the basis of plural images obtained by the image 
picking up, and a cursor is displayed at the decided 
instruction position. In such a case, when the user does not 
move the instruction position, which grid the instruction 
position is located in is decided when the display surface is 
virtually divided into may grids (refer to (A)), and a cursor is 
displayed in the center position of the grid including the 
instruction position. Also, when the user moves the 
instruction position, the cursor is displayed at the instruction 
position or the cursor is displayed in the center position of a 
small area grid including the instruction position by using 
grids of smaller areas (refer to (B)). 
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waver of the instruction position by a user. 

SOLUTION: A situation where an optional place on the display surface of 
a display is instructed by a user is picked up from plural directions, an 
instruction position by the user is decided on the basis of plural images 
obtained by the image picking up, and a cursor is displayed at the decided 
instruction position. In such a case, when the user does not move the 
instruction position, which grid the instruction position is located in is 
decided when the display surface is virtually divided into may grids (refer 
to (A)), and a cursor is displayed in the center position of the grid 
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CLAIMS 



[Claim(s)] 

[Claim 1] Hand pointing equipment characterized by providing the following A display means for displaying an 
image An image pick-up means to picturize a recognition candidate from two or more mutually different 
directions A decision means to extract the image section equivalent to said recognition candidate in said image 
based on two or more images obtained because said image pick-up means picturizes a condition indicating a 
location of specification [ a recognition candidate ] f and to judge a directions location by recognition candidate A 
display-control means to display on a fixed location in said specific region a mark which shows said directions 
location when a directions location judged by said decision means is included in a specific region on the screen of 
said display means 

[Claim 2] Said display-control means is hand pointing equipment according to claim 1 characterized by to make it 
display on the fixed location in the specific region which judged whether the directions location judged by said 
decision means is included in which [ when dividing a screen top of said display means into two or more fields ] 
field, and judged the mark which shows said directions location that said directions location included. 
[Claim 3] Said display-control means is hand pointing equipment according to claim 2 characterized by displaying 
on said directions location or its near on said screen a mark which shows said directions location when it is 
judged that actuation to which a recognition candidate moves a directions location is carried out. 
[Claim 4] When it is judged that said display-control means is carrying out actuation to which a recognition 
candidate moves a directions location It judges whether a directions location judged by said decision means is 
included in which [ when dividing said screen top into many small regions of area below regularity and a 
predetermined value ] small region. Hand pointing equipment according to claim 2 characterized by making it 
display on a fixed location in a specific small region which judged a mark which shows said directions location that 
said directions location is included. 

[Claim 5] It is based on two or more images obtained by picturizing a condition indicating a location of 
specification [ a recognition candidate ] from two or more mutually different directions. Extract the image sectio'n 
equivalent to said recognition candidate in said image, and a directions location by recognition candidate is 
judged. The directions location method of presentation which displays on a fixed location in said specific region a 
mark which shows said directions location when a judged directions location is included in a specific region on the 
screen of a display means for displaying an image. 

[Claim 6] It is based on two or more images obtained by picturizing a condition indicating a location of 
specification [ a recognition candidate ] from two or more mutually different directions. The 1st step which 
extracts the image section equivalent to said recognition candidate in said image, and judges a directions location 
by recognition candidate, And when a judged directions location is included in a specific region on the screen of a 
display means for displaying an image A record medium with which a program for making a computer perform 
processing containing the 2nd step which displays on a fixed location in said specific region a mark which shows 
said directions location was recorded. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to hand pointing equipment, the directions 
location method of presentation, and a record medium, the location to which picturized a recognition candidate 
and a recognition candidate pointed especially judges, and it relates to the record medium with which the program 
for making a computer perform processing concerning the hand pointing equipment which can apply the directions 
location method of presentation and this directions location method of presentation which display the mark which 
shows a directions location, and said directions location method of presentation was recorded. 
[0002] 

[Description of the Prior Art] It has an image pick-up means to picturize the information input person (user) who 
came conventionally near [ which displays predetermined information ] the display and the display from a mutually 
different direction. The condition that the information input person who came pointed to the location of the 
arbitration on a display with the finger etc. is picturized with two or more image pick-up means. While recognizing 
an information input person based on two or more images obtained by the image pick-up, judging the location on 
the display which the information input person directed and displaying cursor etc. on the directions location on a 
display If an information input person detects having performed click actuation which raises the thumb The hand 
pointing input unit which recognizes it as the directions location on a display having been clicked, and performs 
predetermined processing is known (for example, reference, such as JP,4-271423,A, a publication-number 5 No. - 
19957 official report, and JP,5-324181,A). 

[0003] Since according to the above-mentioned hand pointing input unit various kinds of directions are given or it 
becomes possible to an information processor to input various kinds of information, without an information input 
person touching input devices, such as a keyboard and a mouse, the simplification of the actuation for using an 
information processor is realizable. 
[0004] 

[Problem(s) to be Solved by the Invention] By the way, the actuation (directions actuation) indicating the location 
of a request of an information input person is actuation made to stand it still in the air, as an information input 
person turns to the location of raising and the request on the screen of a display of an own fingertip and the 
head of a hand of an own arm, but although it is slight in order to resist the gravity which acts in order to 
maintain this quiescent state, it requires muscular power. In order to follow, for example, to maintain a directions 
location in a fixed location, even if it is going to make an arm, a fingertip, and a hand stand it still in a fixed 
location, it is difficult to make a fixed location stand it still strictly like an anchorage, and it is natural that some 
wandering arises in the location of a fingertip or a hand. 

[0005] On the other hand, since conventional hand pointing equipment was a configuration which displays the 
mark (the so-called cursor) showing a directions location on the directions location by the information input 
person on the screen of a display, in connection with wandering of an information input person's fingertip, or the 
location of a hand, the location of the cursor displayed on a display might give wandering and a user (information 
input person) sense of incongruity. 

[0006] This invention was accomplished in consideration of the above-mentioned data, and it is the object to 
obtain the hand pointing equipment which can control wandering showing a directions location of the display 
position of a mark, the directions location method of presentation, and a record medium irrespective of wandering 
of the directions location by the user. 
[0007] 

[Means for Solving the Problem] Hand pointing equipment applied to invention according to claim 1 in order to 
attain the above-mentioned object A display means for displaying an image, and an image pick-up means to 
picturize a recognition candidate from two or more mutually different directions, A decision means to extract the 
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image section equivalent to said recognition candidate in said image based on two or more images obtained 
because said image pick-up means picturizes a condition indicating a location of specification [ a recognition 
candidate ], and to judge a directions location by recognition candidate, When a directions location judged by said 
decision means is included in a specific region on the screen of said display means, a mark which shows said 
directions location is constituted including a display-control means displayed on a fixed location in said specific 
region. 

[0008] In invention according to claim 1, a recognition candidate (user) is picturized from two or more directions 
which change mutually with image pick-up means. It can also be constituted from picturizing a virtual image of a 
recognition candidate reflected in a flat-surface mirror so that a recognition candidate may be picturized from 
two or more directions, while this image pick-up means may be constituted so that a recognition candidate may 
be picturized from two or more directions with two or more image pick-up equipments which consist of a video 
camera etc., it establishes light-reflex means, such as a flat-surface mirror, and picturizes a recognition 
candidate directly with single image pick-up equipment. 

[0009] Moreover, a decision means extracts the image section equivalent to a recognition candidate in an image 
based on two or more images obtained by picturizing a condition indicating a location of specification [ a 
recognition candidate ] from two or more directions where image pick-up means differ mutually, and judges a 
directions location by recognition candidate. Therefore, if a recognition candidate performs actuation indicating a 
specific location on the screen of for example, a display means, a directions location by recognition candidate will 
be judged. 

[0010] A directions location by recognition candidate can search for a three-dimension coordinate of a reference 
point where a location does not change even if the focus and a recognition candidate from whom a location 
specifically changes because a recognition candidate moves an arm move an arm, and can judge it based on a 
three-dimension coordinate of the focus and a reference point. In addition, a point which corresponds, for 
example at heads, such as a recognition candidate's hand and a finger, or a head of an indicator which a 
recognition candidate is grasping as the focus can be used, and a point which is equivalent to a recognition 
candidate's idiosomas (for example, a thorax, the arm joint, etc.), for example can be used as a reference point. 
[001 1] And a display-control means displays on a fixed location in a specific region a mark which shows a 
directions location, when a directions location judged by decision means is included in a specific region on the 
screen of a display means. Though a directions location by user (namely, recognition candidate who performed 
actuation indicating a specific location on the screen of a display means) of hand pointing equipment concerning 
this invention is unsteady by this Since a mark which shows a directions location is displayed on a fixed location 
in a specific region on the screen of a display means while a directions location is included in a specific region, 
wandering showing a directions location of a display position of a mark can be controlled irrespective of 
wandering of a directions location by user. 

[0012] It is characterized by to display invention according to claim 2 on the fixed location in the specific region 
which judged whether the directions location where a display-control means was judged by decision means in 
invention of claim 1 is included in which [ when dividing a screen top of a display means into two or more fields ] 
field, and judged the mark which shows said directions location that said directions location included. 
[0013] In invention according to claim 2, it will have judged whether a directions location judged by decision 
means is included in which [ when dividing a screen top of a display means into two or more fields ] field, and 
each location on the screen of a display means will be included in any of two or more of said fields they are. And 
since it is made to display on a fixed location in a specific region which judged a mark which shows a directions 
location that a directions location is included, also when a directions location is located in which location on the 
screen of a display means, wandering showing a directions location of a display position of a mark can be 
controlled. 

[0014] In addition, in invention of claim 2, although a location equivalent to a boundary of each field when dividing 
a screen top of a display means into two or more fields may be defined fixed beforehand, it may replace with this 
and may define a location which is equivalent to a boundary of each field on the basis of a directions location first 
judged by decision means. 

[0015] Moreover, although each location on the screen of a display means is made to be included in any of two or 
more fields they are in invention of claim 2, it is good by the content of a display to the screen of a display 
means etc. only also considering specific parts on the screen of a display means (for example, portion 
corresponding to display positions, such as an icon in a case of displaying an icon etc. on the screen, etc.) as a 
specific region. In this mode, only when a directions location is included in a specific region, wandering showing a 
directions location of a display position of a mark is controlled. When display positions, such as an icon, are 
changed, for example, you may make it change a location of a specific region also in this mode according to this 
modification. 
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[0016] By the way, when it is made to include each location on the screen of a display means in any of two or 
more fields they are like invention of claim 2, Since a display position of a mark showing a directions location 
serves as unnatural display that change gradually and a mark showing a directions location moves at intervals in a 
screen top when actuation to which a recognition candidate moves a directions location is performed 
intentionally, sense of incongruity may be given to a user. For this reason, in invention of claim 1, invention 
according to claim 3 is characterized by displaying on said directions location or its near on said screen a mark 
which shows said directions location, when it is judged that a display-control means is carrying out actuation to 
which a recognition candidate moves a directions location. 

[0017] Since a mark which shows a directions location is displayed on a directions location on the screen, or its 
near when it is judged that actuation to which a recognition candidate moves a directions location is carried out 
in invention according to claim 3 When actuation to which a directions location by recognition candidate, a display 
position of a mark which shows a directions location, and ** will carry out abbreviation coincidence, and a 
recognition candidate moves a directions location is performed intentionally A display position of a mark showing 
a directions location will change continuously, and a mark showing a directions location will move smoothly in a 
screen top. Therefore, it can prevent giving sense of incongruity to a recognition candidate (user) who performed 
actuation to which a directions location is moved. 

[0018] In addition, decision whether actuation to which a directions location is moved is carried out can perform 
movement magnitude of a directions location, and movement magnitude per unit time amount (passing speed) as 
compared with a threshold etc. Moreover, it adds to movement magnitude of a directions location per unit time 
amount, smallness of dispersion in the migration direction of a directions location within a certain time amount 
etc. is detected collectively, and it may be made to make the above-mentioned judgment. 
[0019] Invention according to claim 4 is set to invention of claim 2. A display-control means When it is judged 
that actuation to which a recognition candidate moves a directions location is carried out It judges whether a 
directions location judged by decision means is included in which [ when dividing said screen top into many small 
regions of area below regularity and a predetermined value ] small region. It is characterized by making it display 
on a fixed location in a specific small region which judged a mark which shows said directions location that said 
directions location is included. 

[0020] When it is judged that actuation to which a recognition candidate moves a directions location is carried 
out in invention according to claim 4 It judges whether a judged directions location is included in which [ when 
dividing a screen top into many small regions of area below regularity and a predetermined value ] small region. 
Since it is made to display on a fixed location in a specific small region which judged a mark which shows a 
directions location that a directions location is included, when actuation to which a recognition candidate moves 
a directions location is performed intentionally A display position of a mark showing a directions location will 
change gradually, and a mark showing a directions location will move at intervals in a screen top. However, in 
invention of claim 4, since area of a small region is made below into a predetermined value, when actuation to 
which a recognition candidate moves a directions location is performed intentionally, a change step (unit 
movement magnitude of a mark on the screen) of a display position of a mark becomes small. Therefore, it can 
prevent giving sense of incongruity to a recognition candidate (user) who performed actuation to which a 
directions location is moved. 

[0021] The directions location method of presentation concerning invention according to claim 5 It is based on 
two or more images obtained by picturizing a condition indicating a location of specification [ a recognition 
candidate ] from two or more mutually different directions. Extract the image section equivalent to said 
recognition candidate in said image, and a directions location by recognition candidate is judged. Since a mark 
which shows said directions location is displayed on a fixed location in said specific region when a judged 
directions location is included in a specific region on the screen of a display means for displaying an image 
Wandering showing a directions location of a display position of a mark can be controlled irrespective of 
wandering of a directions location by user like invention of claim 1. 

[0022] A record medium concerning invention according to claim 6 a condition indicating a location of 
specification [ a recognition candidate ] It is based on two or more images obtained by picturizing from two or 
more mutually different directions. The 1st step which extracts the image section equivalent to said recognition 
candidate in said image, and judges a directions location by recognition candidate, And when a judged directions 
location is included in a specific region on the screen of a display means for displaying an image A program for 
making a computer perform processing containing the 2nd step which displays on a fixed location in said specific 
region a mark which shows said directions location is recorded. 

[0023] Processing which contains the 1st above-mentioned step and the 2nd step in a record medium concerning 
invention according to claim 6, Namely, since a program for making a computer perform processing concerning 
the directions location method of presentation concerning invention of claim 5 is recorded By reading and 
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executing a program to which a computer is recorded on said record medium, wandering showing a directions 
location of a display position of a mark can be controlled irrespective of wandering of a directions location by 
user like invention of claim 1, and invention of claim 5. 
[0024] 

[Embodiment of the Invention] Hereafter, an example of the operation gestalt of this invention is explained to 
details with reference to a drawing. As shown in drawin g 1 , the big screen display 12 is embedded on the wall 
surface of the part where the information input person 10 as a recognition candidate concerning this invention 
comes. In addition, as a display 12, the display means of common knowledge, such as a liquid crystal display 
(LCD), a plasma display, the Braun tube, and an optical fiber display, is applicable. 

[0025] The display 12 is connected to the information processor 14 which consists of a personal computer etc. 
(refer to drawin g 2 ), and various kinds of information is displayed with various display gestalten, such as a 
graphic form, a table, an alphabetic character, and an image, on the screen by the information processor 14. In 
this operation gestalt, the information input person 10 arrives at the part (information input space) shown in 
drawin g 1 ahead of a display 12, and while he points to the location where the various information on the screen 
of a display 12 is displayed, by performing click actuation (it mentioning later for details), to an information 
processor 14, various kinds of directions are given or he performs various kinds of processings. 
[0026] As shown in drawin g 2 , the controller 22 of the hand pointing input unit 20 concerning this operation 
gestalt is connected to the information processor 14. In addition, the display 12 mentioned above, the information 
processor 14, and the hand pointing input unit 20 support the hand pointing equipment concerning this invention 
to which the directions location method of presentation concerning this invention was applied. 
[0027] The controller 22 is equipped with CPU22A, ROM22B, RAM22C, and input/output interface 22D, and 
these are mutually connected through a bus and it is constituted. While the information processor 14 is 
connected to input/output interface 22D, a keyboard 28. the lighting control unit 30, the image pick-up control 
unit 34, the mark board driving gear 38, and the CD-ROM driver 40 for the display 26 for displaying the storage 
24 having the storage (for example, magnetic disk) of the non-volatile which can rewrite the content of storage, 
and various kinds of information, and an operator to input various kinds of directions and data are connected 
respectively. 

[0028] The program (only henceforth a "program") for operating a controller 22 as hand pointing equipment 
concerning this invention is memorizable to CD-ROM42 with which the CD-ROM driver 40 is loaded. If program 
execution is directed, reading appearance of the program will be carried out from CD-ROM42, and the program by 
which reading appearance was carried out will be performed by the controller 22. Thereby, each equipment 
containing a controller 22 functions as hand pointing equipment. In addition, in the above-mentioned mode, CD- 
ROM42 supports the record medium according to claim 6. 

[0029] Two or more near-infrared light lighting systems 32A and 32B which inject the light of the wavelength of a 
near-infrared region in the shape of a beam are connected to the lighting control unit 30. As shown in drawin g 1 , 
the near-infrared light lighting systems 32A and 32B are arranged in a mutually different part above information 
input space, and the exposure range is adjusted so that the information input person 10 who arrived at 
information input space may be illuminated from a mutually different direction. The lighting control unit 30 
controls burning and putting out lights of lighting systems 32A and 32B. 

[0030] Two or more (refer to drawin g 1 ) video cameras 36A and 36B arranged in a mutually different part above 
information input space are connected to the image pick-up control unit 34. Although video cameras 36A and 
36B omit a graphic display, while they are equipped with the area sensor which changes from CCD which has 
sensitivity to near-infrared light, the filter which penetrates only the light of the wavelength of a near-infrared 
region is prepared in the optical incidence side of the image formation lens to which the light-receiving side of an 
area sensor is made to carry out image formation of the incident light. In addition, the method of discriminating 
"Resemble the far infrared rays by human beings (information input person) temperature, and human beings 
temperature and the far-infrared light emitted to the temperature (it may be a temperature higher than 
temperature, or you may be a low temperature) which separated beyond the predetermined value from setting out 
or the floor by which the temperature control was carried out, using a far-infrared camera as an image pick-up 
means (camera)" from human being and a background may be used. In this case, it also becomes possible to omit 
lighting systems 32A and 32B and the lighting control unit 30. 

[0031] As shown in draw ing 3 , the sense is adjusted so that video cameras 36A and 36B may picturize the 
information input person 10 who arrived at information input space from a mutually different direction. Moreover, 
video camera 36A goes into information input person's 10 who arrived at information input space image pick-up 
within the limits. And the light injected from lighting-system 32A does not carry out direct incidence to an image 
formation lens. And the sense (image pick-up range) is adjusted so that the center of an image pick-up range 
may cross in predetermined height [ in information input space ] from the center and floor line of the lighting 
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range by lighting-system 32A (it separates from an image pick-up range like [ the lighting range on the floor line 
by lighting-system 32A ]). Video camera 36B goes into information input person's 10 who arrived at information 
input space image pick-up .within the limits similarly. And the light injected from lighting-system 32B does not 
carry out direct incidence to an image formation lens. And the sense (image pick-up range) is adjusted so that 
the center of an image pick-up range may cross in predetermined height [ in information input space ] from the 
center and floor line of the lighting range by lighting-system 32B (it separates from an image pick-up range like 
[ the lighting range on the floor line by lighting-system 32A ]). 

[0032] In addition, video cameras 36A and 36B, the image pick-up control unit 34, the lighting control unit 30, and 
the near-infrared light lighting systems 32A and 32B support the image pick-up means of this invention. 
[0033] Moreover, as shown in drawin g 4 , the hand pointing input unit 20 is equipped with the mark board 40 
arranged near the information input space. Much mark 40A is recorded and constituted from at equal intervals by 
the transparent plate in the shape of a matrix, and the mark board 40 is made movable so that information input 
space may be crossed along the direction (the direction of arrow head A of drawin g 4 ) which intersects 
perpendicularly in the array direction of mark 40A. In addition, mark 40A is colored the color (for example, red) 
with the easy recognition on an image. The mark board driving gear 38 connected to input/output interface 22D 
moves the mark board 40 along the direction of arrow head A of dra win g 4 according to the directions from a 
controller 22. 

[0034] Next, as an operation of this operation gestalt, first, when the hand pointing input unit 20 is installed, the 
lattice point positional information initialization process performed by the controller 22 is explained with reference 
to the flow chart of drawing 5 . 

[0035] At step 100, the mark board 40 is moved to a predetermined location (location equivalent to the edge of 
the successive range of the mark board 40) with the mark board driving gear 38. At the following step 102, the 
three-dimension coordinate (x y, z) in the information input space of mark 40A of a large number currently 
recorded on the mark board 40 is respectively calculated in the location of the present mark board 40. At step 
104, the image (Image A is called below) obtained when information input space was made to picturize and video 
camera 36A picturized information input space at the following step 106 with video cameras 36A and 36B through 
the image pick-up control unit 34 is captured through the image pick-up control unit 34. 

[0036] At step 108, mark 40A which exists in the image A captured at step 106 is recognized (extract), and the 
location (XA, YA) on Image A is calculated about recognized all mark 40A in the following step 1 10. And the 
three-dimension coordinate (x y, z) in information input space and the location (XA, YA) on Image A are made to 
correspond, and storage 24 is made to memorize as lattice point positional information of video camera 36A at 
step 1 12 about all mark 40A which exists in Image A. 

[0037] At the following steps 1 14-120, processing to video camera 36B is performed like the above-mentioned 
steps 106-112. That is, the image (Image B is called below) obtained when video camera 36B picturized 
information input space at step 1 14 is captured through the image pick-up control unit 34, at step 1 16, mark 40A 
which exists in the image B captured at step 1 14 is recognized (extract), and the location (XB, YB) on Image B 
calculates about recognized all mark 40A in the following step 118. And the three-dimension coordinate (x y, z) in 
information input space and the location (XB, YB) on Image B are made to correspond, and storage 24 is made to 
memorize as lattice point positional information of video camera 36B at step 120 about all mark 40A which exists 
in Image B. 

[0038] At the following step 122, it judges whether the mark board 40 moved to the last location (location which 
is equivalent to the edge of the predetermined location in step 100, and an opposite hand among the successive 
ranges of the mark board 40). When the judgment of step 122 is denied, it shifts to step 124, and with the mark 
board driving gear 38, after only fixed distance (distance which is in agreement with the gap of mark 40A on the 
mark board 40 in detail) moves the mark board 40 in the predetermined direction, it returns to step 102. 
[0039] As mentioned above, mark 40A of a large number currently recorded on the mark board 40 by repeating 
steps 102-124 until the mark board 40 moves to the last location It is moved to the location corresponding to 
the lattice point of a large number located in a line in the shape of a grid at a fixed gap in information input space. 
As lattice point positional information of video camera 36A While the three-dimension coordinate in the 
information input space of each lattice point and the location on Image A correspond and storage 24 memorizes 
As lattice point positional information of video camera 36B, the three-dimension coordinate in the information 
input space of each lattice point and the location on Image B will correspond, and storage 24 will memorize. 
[0040] In addition, the mark board 40 and the mark board driving gear 38 are used only in the above-mentioned 
lattice point positional information initialization process, and after they perform the above-mentioned processing, 
you may make it remove the mark board 40 and the mark board driving gear 38, since it does not use in the 
processing mentioned later. 

[0041] Moreover, it replaces with the mark board 40 with which mark 40A was recorded, and while carrying out 
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fixed distance [ every ] step migration of the mark board using the mark board with which many light emitting 
devices, such as LED, were arranged by the transparent plate in the shape of a matrix, it may be made to perform 
the above-mentioned processing by repeating making many light emitting devices turn on in order in each 
location in step migration. Moreover, it is also possible to perform the above-mentioned processing by repeating 
having the hand in which the light emitting device was attached, moving a light emitting device to each location 
corresponding to each lattice point with robot arm equipment using the robot arm equipment made movable in 
this hand in the location of the arbitration in information input space, and making the light switch on. 
[0042] Next, with reference to the flow chart of drawin g 6 , after the above-mentioned lattice point positional 
information initialization process is performed, the directions decision processing regularly performed by the 
controller 22 is explained. In addition, this directions decision processing makes a judgment of the directions from 
the information input person 10 who arrived at information input space etc. 

[0043] The image data which expresses with step 1 50 the image A outputted from video camera 36A, and the 
image data showing the image B outputted from video camera 36B are incorporated respectively, based on the 
image data of the captured image A and Image B, it judges [ whether the information input person 10 came into 
information input space, and ] in no (does it exist?), and it stands by until a judgment is affirmed. 
[0044] To be shown in drawin g 8 , while the controller 22 is performing directions decision processing, the lighting 
control unit 30 makes lighting systems 32A and 32B turn on by turns, and the image pick-up of the information 
input space by video camera 36A is performed when lighting system 32A is on, and the image pick-up of the 
information input space by video camera 36B controls the image pick-up control unit 34 to be carried out when 
lighting system 32B is on. 

[0045] Since the image pick-up range of video camera 36A is adjusted so that the lighting range on the floor line 
by lighting-system 32A may separate from an image pick-up range, though non-recognizing object 50A (refer to 
drawin g 3 ), such as the information input person's 10 loading and dust, exists in lighting within the limits on the 
floor line by lighting-system 32A, this non-recognizing object 50A does not go into the image pick-up range of 
video camera 36A. Moreover, though non-recognizing object 50B (refer to drawing 3 ) exists within limits 
picturized by video camera 36A on a floor line, since it has separated from non-recognizing object 50B from the 
lighting range by lighting-system 32A, the brightness of the image section equivalent to non-recognizing object 
50B which exists in Image A becomes very low. 

[0046] Similarly, since the image pick-up range of video camera 36B is adjusted so that the lighting range on the 
floor tine by lighting-system 32B may separate from an image pick-up range, though non-recognizing object 50B 
exists on the floor line illuminated by lighting-system 32B, this non-recognizing object SOB does not go into the 
image pick-up range of video camera 36B. Moreover, though non-recognizing object 50A exists within limits 
picturized by video camera 36B on a floor line, the brightness of the image section equivalent to non-recognizing 
object 50B which exists in Image B becomes very low. 

[0047] Therefore, the judgment of previous step 150 can be managed with very easy decision processing of 
whether in Image A and Image B, it is high brightness and the image section of the area beyond a predetermined 
value exists. When the judgment of step 150 is denied, it stands by until a judgment is affirmed. 
[0048] If the information input person 10 arrives at information input space, the judgment of step 150 will be 
affirmed, it will shift to step 152, and initial setting, such as various kinds of flags and a processing mode, will be 
performed. At the following step 154, it judges whether the information input person 10 left from information input 
space. When the information input person 10 leaves from information input space, it stands by until said judgment 
is affirmed and the information input person 10 arrives at step 150 again in return and information input space, 
but when said judgment is denied, a reference point and focus coordinate data processing are performed at step 
156. Hereafter, this origin/datum and focus coordinate data processing are explained with reference to the flow 
chart of drawing 7 . 

[0049] At step 210, the data of Image A and Image B is respectively incorporated from video cameras 36A and 
36B, and the image section equivalent to the information input person's 10 overview is respectively extracted 
from the captured image A and Image B in the following step 212. It can extract easily by judging the field where 
the area beyond the predetermined value which consists of the pixel of high brightness continued also about the 
image section equivalent to this information input person's 10 overview. 

[0050] At step 214, it asks for the information input person's 10 height based on the image section equivalent to 
the information input person's 10 overview. As shown in drawin g 9 , let the distance h of the point P' and Point P 
which is equivalent to the parietal region of R and the information input person 10 in the distance of the 
intersection Q of the vertical line which passes along f and Point O the focal distance of the image-formation 
lens of the video camera 36 located in Point O, and the floor line of information input space, and the point P on 
the floor line H, and Point Q and the information input person 10 are standing distance with Point O be an 
information input person's theta' and the length of the information input person's 10 image by which image 
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formation is carried out to the light-receiving side of the area sensor of a video camera 36 for the angle at which 
theta and point P'OQ accomplish the angle which Point POQ accomplishes Moreover, h\ a point — P — 
corresponding — light-receiving — a field — a top — image formation — a point — a point — p — a point — P 
— ' — corresponding — light-receiving — a field — a top — image formation — a point — a point — p — 1 — 
light-receiving — a field — a center — o — a point — p — distance — r — light-receiving — a field — a 
center — o — a point — p — ' — distance — r — ' — ** — carrying out — 
[0051] 

theta =tan-1 (R/H) — (1) 
theta'=tan-1 (R/(H-h)} — (2) 
r =f theta — (3) 
r'=ftheta' — (4) 

Therefore, the information input person's 10 height h and distance R can be found by the following (5) types and 

(6) types. 

[0052] 

h=H {1-tan(r/f)/tan (rVf)} — (5) 
R=Htan (r/f) — (6) 

Since distance H and a focal distance f are known, at step 214, it can ask for distance r and r' from either the 
image A obtained by the image pick-up of video cameras 36A and 36B, and the image B, and can ask for the 
information input person's 10 height h by substituting this for (5) types. Moreover, at step 214, it asks for the 
location on the information input person's 10 floor line (two-dimensional coordinate) by finding distance r from 
each of Image A and Image B, substituting this for (6) types respectively and finding distance R respectively. 
[0053] At the following step 216, the three-dimension coordinate (xO, yO, zO) of the information input person's 10 
reference point P0 is determined based on the location on the height h of the information input person 10 who 
asked at step 214, and the information input person's 10 floor line. In addition, as a reference point P0 f the point 
(point P0 shown in drawin g 12 ) which is equivalent to the information input person's 10 back, for example can be 
used. In this case, the three-dimension coordinate of a reference point P0 can be determined by setting up the 
location on the floor line of indexing and the information input person 10 (plane coordinates) for the height (for 
example, value of zO) from the floor line of the reference point P0 which is equivalent to the information input 
person's 10 back based on the information input person's 10 height h as plane coordinates (for example, value of 
xO and yO) of a reference point P0. In addition, it may replace with the point equivalent to the information input 
person's 10 back, and the point equivalent to the information input person's 10 thorax, the point equivalent to the 
information input person's 10 arm joint, etc. may be used. 

[0054] At step 218, the information input person 10 judges whether actuation (directions actuation) which points 
to a display 12 side with a finger etc. is performed based on the configuration of the image section equivalent to 
the overview of the information input person 10 on Image A and Image B. Since the direction of the display 12 
seen from the information input person 10 is known, the judgment of step 218 is realizable for the information 
input person's 10 hand in the image section equivalent to the information input person's 10 overview by 
considerable, then judging whether there is any portion which projects in the height location which can be judged 
toward the direction of the display 12 seen from the information input person 10. 

[0055] If the information input person 10 improves an arm and turns a hand to a display 12 side by this from the 
straight condition shown in drawi ng 10 (A) as shown in dr awi ng 10 (B) or (C), it will be judged with the information 
input person 10 performing directions actuation. When the judgment of step 218 is denied, a reference point and 
focus coordinate data processing are ended without calculating the three-dimension coordinate of the focus (it 
mentioning later for details). 

[0056] When the information input person 10 is performing directions actuation, the judgment of step 218 is 
affirmed and it shifts to step 220. Based on the image data which expresses with step 220 the image A captured 
from video camera 36A, the focus PX of the information input person 10 who exists in Image A is extracted, and 
the location (XA, YA) of the focus PX on Image A is calculated. The point which corresponds at the head of the 
finger which is performing actuation indicating a display 12 side as the information input person's 10 focus PX can 
be used. In this case, equivalent to the information input person's 10 hand among the image sections showing the 
information input person's 10 overview, then the location at the head of a portion which projects toward the 
direction of a display 12 in the height location which can be judged can be calculated as a location of Focus PX. 
[0057] As the information input person's 10 hand shows drawi ng 1 1 (A) by video camera 36A, when it is 
picturized by this, the coordinate (XA, YA) of Focus PX shown in drawin g 1 1 (B) will calculate as a location of 
Focus PX. 

[0058] Based on the lattice point positional information of video camera 36A memorized by storage 24, all the 
lattice points when the location on Image A goes into the range of (XA**dX, YA**dY) (see the range surrounded 
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by hatching to drawin g 1 1 (B)) are searched with step 222. In addition, this magnitude of dX and dY is set that at 
least one or more lattice points are extracted based on the gap (gap of mark 40A) of the lattice point. 
[0059] Moreover, with this operation gestalt, the wide angle lens is used as an image formation lens of a video 
camera, and if dX and dY are set constant, many lattice points go into the range of (XA**dX, YA**dY), and lead 
to lowering of the precision of the operation of the three-dimension coordinate of Focus PX mentioned later as 
the distance of a video camera and the lattice point becomes large. For this reason, dX and dY are set up so that 
a value may become small, as the distance from the video camera on a three-dimension coordinate separates. 
Therefore, the range equivalent to (XA**dX, YA**dY) on a three-dimension coordinate serves as the shape of a 
rectangular-head drill to which the base is located in a video camera side. 

[0060] Based on the image data which expresses with step 224 the image B captured from video camera 36B like 
previous step 220, the focus PX of the information input person 10 who exists in Image B is extracted, and the 
location (XB, YB) of the focus PX on Image B is calculated. Based on the lattice point positional information of 
video camera 36B memorized by storage 24, all the lattice points when the location on Image B goes into the 
range of (XB**dX, YB**dY) are searched with step 226 like previous step 222. 

[0061] At the following step 228, the lattice point extracted from Image A and Image B in common is judged. Two 
or more extracts only of the lattice point which exists in the location which approached Focus PX in information 
input space by this will be carried out. At step 230, the three-dimension coordinate of the lattice point extracted 
from Image A and Image B in common is incorporated from lattice point positional information. 
[0062] With this operation gestalt, the three-dimension coordinate of Focus PX is calculated by interpolation 
from the three-dimension coordinate of two or more lattice points which exist in the location which approached 
Focus PX in information input space so that it may mention later (specifically, the coordinate value of the three- 
dimension coordinate of Focus PX is calculated with the weighted mean of the coordinate value of the three- 
dimension coordinate of two or more of said lattice points). The operation of the three-dimension coordinate of 
Focus PX is preceded. For this reason, at the following step 232 The location on the image A of each lattice 
point extracted from Image A and Image B in common, and Image B, the interpolation from the three-dimension 
coordinate of each lattice point extracted from Image A and Image B in common based on the location (XA, YA) 
of the focus PX on Image A, and the location (XB, YB) of the focus PX on Image B — comparatively (weight to 
the coordinate value of the three-dimension coordinate of each lattice point) — determining . The rate of this 
interpolation can be determined that the weight of the coordinate value of the three-dimension coordinate of 
Focus PX and the lattice point which exists in the location which approached will become large on Image A and 
Image B. 

[0063] And at step 234, the three-dimension coordinate (XX, YX, ZX) of Focus PX is calculated based on the 
three-dimension coordinate of the lattice point extracted from Image A and Image B in common, and the rate of 
the interpolation determined at step 232. If the three-dimension coordinate of Focus PX is calculated as 
mentioned above, a reference point and focus coordinate data processing will be ended, and it will shift to step 
1 58 of directions decision processing ( drawin g 6 ). In addition, since repeat activation of the above-mentioned 
reference point and focus coordinate data processing is carried out, the value of the three-dimension coordinate 
of the reference point P0 calculated by this processing and Focus PX will be serially updated according to the 
information input person's 10 position, or a change of operation. 

[0064] At step 158, it judges whether the information input person 10 is performing directions actuation based on 
the judgment result of step 218 of a reference point and focus coordinate data processing ( drawing 7 ) explained 
previously. In addition, by the reference point and focus coordinate data processing, since the three-dimension 
coordinate of Focus PX is calculated only when the information input person 10 is performing directions actuation 
(when the judgment of step 218 is affirmed), the judgment of step 158 can be performed by judging whether the 
three-dimension coordinate of for example, the focus PX calculated. When this judgment is denied, while the 
information input person 10 exists in step 154 in return and information input space, step 154 - step 158 are 
repeated. 

[0065] Based on the three-dimension coordinate of the reference point P0 which shifted to step 160 on the 
other hand when the judgment of step 158 was affirmed, and was calculated by previous reference point and 
focus coordinate data processing, and Focus PX, as a direction to which the information input person 10 is 
pointing As a location (directions location) to which searches for the direction where the imaginary line (imaginary 
line 54 reference of drawin g 12 ) which connects an above-mentioned reference point P0 and above-mentioned 
Focus PX is prolonged, and the information input person 10 is pointing The coordinate (plane coordinates) of the 
intersection (refer to point [ of drawin g 12 ] S) of the flat surface containing the screen of a display 12 and said 
imaginary line is calculated. Thus, step 160 supports the decision means of this invention with the reference point 
and focus coordinate data processing explained previously. 

[0066] At the following step 162, it judges whether the information input person 10 is pointing to the inside of the 
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screen of a display 12 based on the coordinate of the directions location calculated at step 160. When the 
judgment of step 162 is denied, it returns to step 154. On the other hand, when the judgment of step 162 is 
affirmed, it shifts to step 164, and the coordinate of the directions location by the information input person 10 
who calculated at previous step 160 is made to correspond with the present time of day, and is memorized to 
RAM22C. 

[0067] At the following step 166, it judges whether the directions location by the information input person 10 had 
change as compared with the coordinate of the directions location which calculated last time the coordinate 
(coordinate of a current directions location) of the directions location calculated at step 1 60 this time at step 
160. Also when the coordinate of a directions location is calculated last time and the information input person 10 
is not pointing to the inside of the screen of a display 12, the judgment of this step 166 is unconditionally denied, 
while being denied, when the coordinate of a current directions location is in agreement with the coordinate of 
the directions location calculated last time. When the judgment of step 166 is denied, since it can judge that 
actuation to which the information input person 10 moves a directions location is omitted, it shifts to step 168. 
[0068] Moreover, also when the coordinate of a directions location is calculated last time, the information input 
person 10 is performing directions actuation, and when the coordinate of the present directions location is the 
last coordinate and the last inequality of a directions location, the judgment of step 166 is affirmed, it shifts to 
step 172, and when the coordinate of a directions location calculates last time, the movement magnitude of the 
directions location of a from judges whether it is beyond a predetermined value. Although a directions location is 
moving when the judgment of step 172 is denied, the movement magnitude is under a predetermined value (since 
repeat activation of step 160 or subsequent ones is carried out while the information input person 10 is 
performing directions actuation, the passing speed of a directions location is also under constant value), and 
since it can judge that actuation to which the information input person 10 moves a directions location omits, it 
shifts to step 1 68. 

[0069] with this operation gestalt, as an example, as a dashed line show, the coordinate of the boundary location 
of each grid when divide the screen of a display 12 into many grids virtually and the mid gear (location show in 
drawin g 13 (A) by "-") of each grid be beforehand memorize as data by make the rectangle field (henceforth a 
"grid") of predetermined area into an unit at drawin g 13 (A). In addition, many grids (the 1st grid) shown in 
drawin g 13 (A) support two or more fields according to claim 2. At step 168, a current directions location judges 
whether it is located in [ of many grids ] which grid (contained) for the coordinate of a current directions location 
as compared with the coordinate of the boundary location of a grid. 

[0070] And at the following step 170, the coordinate of the mid gear (location shown in drawin g 13 (A) by "-") of 
the grid (it corresponds to the specific region of this invention) judged that includes the directions location 
present at step 168 is outputted to an information processor 14 as a coordinate of the location which should 
display cursor, and the display of cursor (mark which shows the directions location concerning this invention) is 
directed. Thereby, an information processor 14 displays cursor on the location (location which corresponds in the 
center of a grid including a current directions location) where it was directed on the screen of a display 12. The 
above-mentioned steps 168 and 170 support the display-control means (in detail display-control means 
according to claim 2) of this invention. 

[0071] thus, while the information input person 10 is only performing directions actuation, (when omitting 
actuation to which a directions location is moved) Since cursor is displayed on the mid gear of a grid including a 
current directions location Though the directions location by the information input person 10 is unsteady, while 
the directions location is located in a specific grid, cursor is displayed on a fixed location, i.e., the location which 
corresponds in the center of the specific grid on the screen of a display 12. Therefore, irrespective of wandering 
of the directions location by the information input person 1 0, wandering of the display position of cursor can be 
controlled and it can prevent giving the information input person 10 sense of incongruity. 
[0072] On the other hand, since it can judge that the information input person 10 is performing directions 
actuation when the judgment of step 1 72 is affirmed, the coordinate of a current directions location is outputted 
to an information processor 14 as a coordinate of the location which should display cursor, and the display of 
cursor is directed. Thereby, an information processor 14 displays cursor on the location (current directions 
location) where it was directed on the screen of a display 12. This step 174 supports the display-control means 
according to claim 3. 

[0073] When the above-mentioned step 1 74 performs the actuation to which the directions location by the 
information input person 10 is moving the screen top of a display 10 with the passing speed more than constant 
value and to which the information input person 10 moves a directions location since between repeat activation is 
carried out and cursor is displayed on the directions location at that time, the display position of cursor changes 
continuously and cursor will move smoothly in the screen top of a display 12. Therefore, it can prevent giving 
sense of incongruity to the information input person 10 who performed actuation to which a directions location is 
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moved. In addition, you may make it display cursor on the location which replaced with displaying cursor on a 
current directions location as mentioned above, for example, carried out specified quantity offset from the 
current directions location in consideration of improvement in the visibility of the cursor by the information input 
person 10. 

[0074] If cursor is displayed on a display 12 by step 170 or step 174 mentioned above, at the following step 176, 
it will judge whether click actuation was performed by the information input person 10. The actuation (it is called 
"an advance click" refer to drawing 14 (A) and the following) for which can adopt various actuation as click 
actuation, for example, the information input person 10 moves a hand ahead quickly, and the actuation (it says as 
"a go-astern click" refer to drawin g 14 (B) and the following) to which the information input person 10 moves a 
hand quickly back can be carried out as click actuation. Since this click actuation is actuation very natural as 
actuation which points to it and chooses the specific part on the screen of a display 12, a recognition candidate 
can perform click actuation, without feeling sense of incongruity. 

[0075] While the information input person 10 is performing directions actuation, the judgment of whether advance 
click actuation and go-astern click actuation were performed can carry out the repeat operation of the distance 
k of a reference point P0 and Focus PX (refer to drawin g 12 ), and can be performed in step 1 76 because the 
difference of the distance k calculated this time and the distance k calculated last time judges whether it is 
beyond a predetermined value. Although it returns to step 154, without processing in any way when the judgment 
of step 176 is denied When the judgment of step 176 is affirmed, it shifts to step 178. The information (for 
example, information showing the directions location at the time of click actuation (click location), information as 
which the click actuation performed by the information input person 10 expresses an advance click or a go- 
astern click) about the click actuation performed by the information input person 10 is notified to an information 
processor 14. 

[0076] Thereby, an information processor 14 performs predetermined processing based on the information about 
the notified click actuation. Although processing of arbitration is employable as this predetermined processing for 
example, when the advance click of the part which shows the icon showing the specific application on the screen 
of a display 12 is carried out When the go-astern click of the part which starts said specific application, for 
example, shows said icon is carried out Special processing relevant to said specific application (for example, 
setting out the various parameters about application) When the advance click of a table example and the further 
specific special processing is carried out in setting out of the parameter about the version display of application, 
and the display of an icon etc., it can process performing clicked special processing etc. 

[0077] Moreover, while for example usually preparing two or more sorts of processing modes beforehand like a 
processing mode, file transfer mode, and file search mode A mode change directions means for the information 
input person 10 to direct the change to or [ any of two or more sorts of processing modes ] (you may be a foot 
switch and) the device (algorithm) which detects whether processing-mode change directions actuation of the 
information input person 10 changing the form of a hand was performed — you may be — when it prepares and 
click actuation is performed, it may be made to perform different processing for every processing mode. 
[0078] In addition, although the condition of lengthening the elbow is natural when the information input person 10 
has taken down the arm In order to point to the location of the request in the screen of a display 12, when an 
arm is improved, an elbow bends a little automatically (even if it considers performing click actuation later). The 
elbow will have bent a little more automatically [ when the direction of the actuation which improves an arm for 
an elbow with bending a little changes into the condition of pointing to the desired location ] than the actuation 
which improves an arm, with an elbow lengthened. By rational one The distance k of a reference point P0 and 
Focus PX changes in the midst of the actuation whose information input person 10 improves an arm. If this is 
taken into consideration, after the condition of pointing to the location where the information input person 10 
corresponds in the screen of a display 12 will continue beyond comparatively short time amount, it is desirable to 
forbid the advice of a purport to which the judgment of whether click actuation was performed was started or 
click actuation to an information processor 14 was performed. Thereby, when the directions location by the 
information input person 10 changes from the outside of the screen of a display 12 into the screen, it can 
prevent incorrect-judging that click actuation was performed. 

[0079] Moreover, when it takes into consideration that a directions location may shift in the midst of the click 
actuation by the information input person 1 0, it is desirable to use the directions location at the time of the 
information input person 1 0 starting click actuation as a click location. Thereby, even if a directions location 
shifts in the midst of click actuation, the information input person 10 can perform certainly processing 
corresponding to the location to which it was pointing at the beginning. 

[0080] Next, only a different portion from directions decision processing ( drawin g 6 ) in which other examples of 
directions decision processing were previously explained with reference to the flow chart of drawing 1 5 as other 
operation gestalten of this invention is explained. 
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[0081] With this operation gestalt, the grid (the 1st grid) shown in drawin g 13 (A) is made into an unit. The 
boundary location of each grid when dividing the screen of a display 12 into many virtually, And it has memorized 
beforehand as data of the 1 st grid used when omitting actuation to which the information input person 1 0 moves 
a directions location for the coordinate of the mid gear of each grid. Furthermore, as data of the 2nd grid used 
while performing actuation to which the information input person 10 moves a directions location, as a dashed line 
shows to drawin g 13 (B) as an example The rectangle field (henceforth "the 2nd grid") of small area is made into 
an unit rather than the 1 st grid. The coordinate of the boundary location of each 2nd grid when dividing the 
screen of a display 12 into many virtually and the mid gears (location shown in drawin g 13 (B) by "-") of the 2nd 
grid is memorized beforehand. In addition, many 2nd grids shown in drawin g 13 (B) support the small region of a 
large number according to claim 4. 

[0082] In the directions decision processing shown in drawin g 15 , when the directions location by the information 
input person 10 is moving with the passing speed more than constant value in the screen top of a display 12, it 
shifts to step 173 (namely, when the judgment of steps 166 and 172 is affirmed). As compared with the 
coordinate of the boundary location of the 2nd grid, a current directions location judges whether it is located in 
[ of many 2nd grids ] which grid (contained) for the coordinate of a current directions location. 
[0083] And at the following step 175, the coordinate of the mid gear (location shown in drawin g 1 3 (B) by "-") of 
the grid (it corresponds to a specific small region according to claim 4) judged that includes the directions 
location present at step 173 is outputted to an information processor 14 as a coordinate of the location which 
should display cursor, and the display of cursor is directed. Thereby, an information processor 14 displays cursor 
on the location where it was directed on the screen of a display 12. 

[0084] Since repeat activation of the above-mentioned steps 173 and 175 is carried out while the directions 
location by the information input person 10 is moving with the passing speed more than constant value in the 
screen top of a display 12, when actuation to which the information input person 10 moves a directions location 
is performed, cursor will move at intervals in the screen top of a display 12 (step migration). However, rather than 
the 1st grid, the 2nd grid is small area and is divided into the grid of many [ screen / of a display 12 ], and since 
the gap of the center position of an adjacent grid is also small, cursor will carry out step migration by smaller 
migration width of face. Therefore, it can prevent giving sense of incongruity to the information input person 10 
who performed actuation to which a directions location is moved. Thus, steps 1 73 and 1 75 support the display- 
control means according to claim 4. 

[0085] In addition, although cursor was displayed on the mid gear of the grid as a specific region which starts this 
invention above, it is not limited to this and the display position of cursor can be made into the location of the 
arbitration in a specific region including the boundary location of a specific region. Moreover, although the specific 
region was made into the shape of a rectangle in the above, it may not be limited to this, you may be N square 
shape (N>=3), and it is good also as circular including an ellipse. Moreover, in having made especially the 
configuration of a specific region circular etc., a part of adjacent specific region may lap so that each location on 
the screen may be included at least in which specific region. The specific region which exists in the location near 
the last directions location among two or more duplicate specific regions is chosen, and you may make it display 
cursor in the selected specific region in this mode, when the part where two or more specific regions on the 
screen overlap is directed so that migration of the display position of cursor may be controlled. 
[0086] Moreover, although the example which prepared two sets of video cameras 36A and 36B above was 
explained, it is not limited to this, and information input space is picturized respectively and you may make it 
judge the directions from the information input person 10 with many video cameras more. 

[0087] Moreover, although the point equivalent to a fingertip was explained to the example as the focus PX which 
starts this invention above, you may make it the focus use the point equivalent to a recognition candidate's wrist, 
and the point equivalent to the back of a recognition candidate's hand as the focus that what is necessary is just 
the point that a location changes because a recognition candidate moves an arm. 

[0088] Furthermore, when the information input person's 10 position changes from the condition (refer to drawin g 
1_i (B) or (O) which is improving the arm to the condition (refer to drawing 1 1 (A)) of having taken down the arm, 
cursor is continued in a directions location just before taking down an arm, and you may make it display on it. 
Since it becomes unnecessary for the information input person 10 to. continue improving an arm continuously by 
this also in that the information input person 10 wants to continue and display cursor on a fixed part (for 
example, presentation of a board etc.) etc., the information input person's 10 burden is mitigable. 
[0089] Moreover, above, as click actuation, although he was trying to judge only the advance click actuation the 
information input person 10 moves [ actuation ] a hand ahead quickly, and the go-astern click actuation to which 
the information input person 10 moves a hand quickly back By supervising transition of the distance k of not the 
thing limited to this but the reference point P0 and Focus PX [ predetermined time ] General double click 
actuation in actuation of a mouse (with hand pointing equipment) for example, the actuation which performs 
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advance click actuation or go-astern click actuation twice in succession [ actuation etc. ] — it can substitute — 
drag-and-drop actuation (with hand pointing equipment) for example, a series of actuation of advance click 
actuation -> directions impaction efficiency actuation -> go-astern click actuation etc. — it can also substitute 
— you may make it judge 

[0090] Moreover, it is also possible to apply well-known displays, such as a plasma display, CRT, and an optical 
fiber display, as a display 12, and to apply liquid crystal goggles etc. Moreover, you may make it display the three- 
dimension-image which expresses three-dimension space in false on a display. The image in accordance with the 
above one flat-surface display ** transillumination or two-point transillumination may specifically be displayed, an 
image may be displayed on the three-dimension display using a liquid crystal shutter or a lenticular lens, or you 
may make it display a stereogram image with the application of holography technology. 
[0091] Furthermore, although CD-ROM42 was explained to the example as a record medium applied to this 
invention above, it cannot be overemphasized that this invention is not limited to this and it can apply as a record 
medium applied to this invention in various kinds of information storages, such as magneto-optic disks, such as 
optical disks, such as magnetic disks, such as an integral hard disk of a hard disk drive unit and FD, and CD-R, 
and MO, a memory card, and an IC card. 
[0092] 

[Effect of the Invention] As explained above, invention and invention according to claim 5 according to claim 1 It 
is based on two or more images obtained by picturizing the condition indicating the location of specification [ a 
recognition candidate ] from two or more mutually different directions. Judge the directions location by the 
recognition candidate, and since it was made to display on the fixed location in a specific region the mark which 
shows a directions location when the judged directions location was included in the specific region on the screen 
of a display means Irrespective of wandering of the directions location by the user, it has the outstanding effect 
that wandering showing a directions location of the display position of a mark can be controlled. 
[0093] Invention according to claim 2 judges whether in invention of claim 1, a directions location is included in 
which [ when dividing the screen top of a display means into two or more fields ] field. Since it is made to display 
on the fixed location in the specific region which judged the mark which shows a directions location that a 
directions location is included Also when the directions location is located in which location on the screen of a 
display means in addition to the above-mentioned effect, it has the effect that wandering showing a directions 
location of the display position of a mark can be controlled. 

[0094] Since the mark which shows a directions location displays on the directions location on the screen, or its 
near when it judged that invention according to claim 3 is carrying out the actuation a recognition candidate 
moves a directions location to actuation in invention of a claim 2, it has the effect that it can prevent giving 
sense of incongruity to the user a user performed the actuation move a directions location to actuation in 
addition to an above-mentioned effect. 

[0095] When it is judged that invention according to claim 4 is carrying out actuation to which a recognition 
candidate moves a directions location in invention of claim 2 Since it is made to display on the fixed location in 
the specific small region which judged whether a directions location would be included in which [ when dividing a 
screen top into many small regions of the area below regularity and a predetermined value ] small region, and 
judged the mark which shows a directions location that a directions location is included It has the effect that it 
can prevent giving sense of incongruity to the user who performed actuation to which a directions location is 
moved in addition to the above-mentioned effect. 

[0096] Invention according to claim 6 is based on two or more images obtained by picturizing the condition 
indicating the location of specification [ a recognition candidate ] from two or more mutually different directions. 
When the 1st step which judges the directions location by the recognition candidate, and the judged directions 
location are included in the specific region on the screen of a display means Since the program for making a 
computer perform processing containing the 2nd step which displays on the fixed location in a specific region the 
mark which shows a directions location was recorded on the record medium Irrespective of wandering of the 
directions location by the user, it has the outstanding effect that wandering showing a directions location of the 
display position of a mark can be controlled. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[ Drawin g 1] It is the perspective diagram showing the circumference of information input space. 

[ Drawin g 2] It is the block diagram showing the outline configuration of the hand pointing input unit concerning 

this operation gestalt. 

[D ra wing 3] It is the schematic diagram showing an example of the relation between the lighting range of a lighting 
system, and the image pick-up range of a video camera. 

[ Drawin g 4] It is the perspective diagram of information input space showing an example of a mark board. 

[ Drawin g 5] It is the flow chart which shows a lattice point positional information initialization process. 

[Drawing 6] It is the flow chart which shows the content of directions decision processing. 

[ Drawin g 7] It is the flow chart which shows the content of an origin/datum and focus coordinate data 

processing. 

[Dra win g 8] It is the timing chart which shows the timing of the output (incorporation) of the image obtained by 
burning and putting out lights of lighting systems A and B, and the image pick-up of a video camera. 
[ Drawin g 9] It is the side elevation of information input space for explaining the operation of an information input 
person's height, and the location on a floor line. 

[Drawing 10] (A) Or (C) is image drawing showing an example of actuation of an information input person. 
[Drawing 1 1] Image drawing showing an information input person's hand that (A) was picturized with the video 
camera, and (B) are the conceptual diagrams showing the retrieval range of the lattice point for searching for the 
coordinate of the focus, and the three-dimension coordinate of the focus. 

[ Drawin g 12] (A) for explaining the judgment of the location on the display to which the information input person 
is pointing is the plan of information input space, and (B) is the side elevation of information input space. 
[ Drawin g 13 ] The grid for determining the display position of the cursor used when omitting actuation to which an 
information input person moves a directions location, and (B) are image drawing showing respectively the grid 
used while performing actuation to which an information input person moves a directions location in (A) in the 
directions decision processing shown in drawing 15 . 

[ Drawin g 14 ] It is image drawing for (A) to explain advance click actuation and for (B) explain go-astern click 
actuation. 

[ Drawin g 15] It is the flow chart which shows the content of other directions decision processings. 
[Description of Notations] 
10 Information Input Person 
12 Display 

14 Information Processor 
20 Hand Pointing Input Unit 
22 Controller 
36 Video Camera 
40 CD-ROM Driver 
42 CD-ROM 
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#180 ^ffSUTV^tLtt, ^M»5 0Bli 
KB9i£B3 2 A(dJ:5fiSP^©H^^^^xTVN-5cor\ ® 
«A«f«c#4-r5*B»»ft4* sob icffiS-TSWMB 

[0 0 4 6] ^iC, tf^Th^ ^73 6B (OiR^ffifflJi 
fig^i£B3 2 Blc±5*ffi±(OflBM«H^»«ISH^e> 
*Ht,3 <t 9t-IHS$ttTV>5<0-C% 1^813 2 BK«fc 

^fctUt), r<0#g«»«*5 0 B^^rt*^ 7 
3 6 BOj«MSlli:A5wiB4v^ ifc, flcB±(Olf 
7 3 6 B^±or«fft$ixS*SHrttci*BBij* 
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[0 0 4 7] «ot, 5t^^X5/^l 5 OcDW^fct. 0g 
x.fili«AXt/iij«B'f iS5jSaET*^ogff^tt«±to 

[0 0 4 8] ««A;ftfflWIIC*«A*# 1 0 dS5J*-*-S 
5 OcO^J^if^tLT;*^ ;y Xl 5 2 

9o W^7^15 4m ««A*fflDB*»e>flWRA 
tbT^x^^l 5 OlcM^ *«AyjffilBJcWft*«A 

fc»-&tctt, ^f^i56 xmm& • «p*j&ffi««# 

[0 0 4 9] *7-y7 2 1 0t(it^> 73 6A, 
3 6 Bd*feSilftAat5HlfeB<07*— ^Sr*/rBtOii*, 
fc<D* : ry-7 2 1 2T^iSl!9iZ t A/^i[S^A&t^M^B^ 

0 = t a n-i (R/H) 

0 ' - t a n-l {R/ (H-h) } 

r = f 0 

r ' = f 9 ' 

S£oT. «*A*#1 0O#*hftt5EdRtt*«5 
(5) SXU* (6) ai:±ot*M:tm5, 

h=H { 1 - t a n (r/f ) / t 
R = H tan (r/f) 

4t1i^7t^^7 3 6A, 3 6 BOj8«feH«tot#e) 

ixfcW«AftVW*BOftrixd^6ffi*r , r' 

ft, (5) a^«;Ai"5-fc«cJ; 9«*A*#1 

HttAXt5ji!«BO«-«rd^ig|ltr Sr*», C 
HS: (6) S:«c#-<rftAbrE«RS:#^*»aci^ 
«fc 5 > t»fgA^# 1 0 Oi*® _hcofim ( 2 2k5cJffi«) £ 

[0 0 5 3] *C0^^^^2 1 6TU ^7^/214 
^*»ft««A*t 1 0 h &r>*tii « A^# 1 0 <D 

*BJbtf>ffiBt-S<5£\ it*A^#l O^Sip^PoO 
3#c5cJffiS (xo, yo, zo) «r*fti-5. 
Po^ttll «*.«ttf«A*#l 0©* + lctB3-*-5 
(@i2(OTt^p 0 ) ^^-c#-5 0 :o 

iSSAM l 0co#5h(cS<5^Tlf$RA;^l 

tfzoCDtt) Srf»Jt)ttSL. 1f« A*# 1 0 co^®±co{i 
S (W-mmm) SrS2P^Po05pffiMS (Wifixo, y 
o<ott) ilt^t^I^^J:^ S2p,&Po<£>3&7C 



[0 0 5 0] 1 4t'lt mmAJd^l 0(D± 

flc«KtBa-*-*H««f^*-5*, MAMlO(OtI 

3 eojg^uvX^^^KlBSr f , ,&0£iI3 
ftiUft £{ft «A*ffilB*>*Bi: co^Q £ *0 t <om& 
jftQiflHlAAt l 0*4orv^*B±©AP 
<t<ogBit£R, if«AMiO^]i»:tSSt§^ 
P' t^PiOEE«hSr««A*#l 0O#*ti-S o 

£0' . trr ^ 7 3 6 ox y 7 1 y t^53tffii^ 

0' . ffi«r, r* (1) - (4) 5&&» 

[0 0 5 1 ] 

■■• (1) 
- (2) 
- (3) 
... ( 4 ) 

[0 0 5 2] 

an <r' /£) } - (5) 

- (6) 

HS:^t6rtiS-e#5, 4*3, tf#A^#10cD 
[0 0 5 4] ^7^//2 1 8tlt H^A5.T>*B^B± 

•e^iSftAAf i o <o^#fl»cffiSi-siii«W5o®«^ 
S-^vnT, IfAMlomCiDr-f^^Wl 

s-rso mmAxmi od^atf^^w 1 2^ 

[0 0 5 5] dtUCkSK tt$BA^#l 02s, mi 0 
(A) ic*-t-E£3R*a*<b, 0 10 (B) (C) Id 

^^0\ZM^kyfX^^f^^-f\y^ 1 2ftlJICfatf*L 
5: t\z?j:Z> 0 ^r^7 p 2 1 8^^$ix^ 
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fas, fttik&o 3 ikTtmw&fcW mmz&m 

[0 0 5 6] »«AAtl 0&t%^W)ft*ftoX\,^m 
2 0^»fft5o ^T^7 P 2 2 0m t*f^^7 3 

JSfcUU IB«A±-C04#«^PxOffi« (Xa, Ya) Sr 
«3S-T3o flMBA;*#l 0O#m^Pxt LTtt, 

0^W«4«tI««©5t,, fflf#A;*j#l 0 

Sr. WIAPxoffili: LtMtS-ims. 
[0 0 5 7] mi-J: «9. tr^^7 3 6AlCiot 
WlMtlO^Hll (A) tc^-t-J:5^»ffe£ 
tL/c4§-g\ #^,&Px<Offig£ LT\ Ell 1 (B) \Ztjk 
■f#«jSPxOJffi« (Xa, Ya) ^f^n^rtlc^ 

So 

[0 0 5 8] 7* : ry72 2 2 Til |S«3£B 2 4 tdlEtfc 

HlftA±-C©flrlldS (X A ±dX, Y A ±dY) 
ffl (Bill (B) «c/N-x^^^t?H^*:«5H*#BK) I- 
AS^Sr^tft^tSo 4*5, CcOdX&^d YCO 
»^ CO ran (^-^40A^» 

[0 0 5 9] Sfc, ***»lB'T?ttlf7 !f ^>7 0jieife 

# < 4S^oT^<<D|&^6a 5 (X A ±dX, Y A ±d 
Y) 0>©Hi;:AtK «3*-rS««^Px<0 3»c5cJffi«© 
«»O*|ft<0(STIc*36sa o z<Dtztb* dXMdY 
il 3ft7nMS_bT^lf^^^ 7^e>OEgf8^sffllix-5 

yk%mm±x*(D (x A ±dx, Y A ±dY) ictss^^gg 

[0 0 6 0] ^r^/2 2 4T1j:, ^^7-7^2 2 0 
fcPWRl^ ^7***^93 6 B^5>Bi9iiA/rt:li*BSr 

ftmi 0O»iAPxt»IUU BfftB±-CO*jf*APx 
Ofig (Xb, Yb) SrSlf-t" So ^f^2 2 6m 

rv^str^^^ 9 3 6 B<Dt&^k(£fi1t$B«-S<5#* 
PHfcB_h"C<DfiMtJ&* (X B ±dX, Y B ±dY) (affifflM 

A*»^^S:^Tai*i-*o 
[0 0 6 1] tk(DXT*y72 2 8T1i, Htft A&r_«i{i> 
B3&>b*iiicatHb*:»^SrJpJSi-5 0 mciJ: 9 . 



flMRA*ffllBrt-e»«* Px«-ifi* UfcffiBfcflqSE LT 
2 3 OTil ■lkAatfH«B^6#a«CttfflLfc«HF- 

[0062] ^mmmmxit, s <t 9 few** p 

x©3ft5cffi«**«A*ffilBrtT4WAPxKiE«Lfc 

{cj;oTi1S#-f S (*ffWlc(4, «rfE**<0»^0> 3 
l*5Effi*Offi*lit<0**ft#5p*&(cJ: 9 4mfiPx£>3 

3«fe7U^O^(c5fei:^. j!k^fy7 p 2 3 2m 
H«AftUWfeBa»&#aicttffl Lfc#»^OH*A 
fttfMifeB_h-C<Offi«, HfcA±TW#£L£Pxtf>ffi« 
(Xa, Ya) . M^B _bT*co#^ PxOfig; (Xb, Y 
b) [Cfio*^T. H^AXt^S^B^^ftaitCtttUL/c 
#«R L *0 3Jfc7cffi«^5><Ort#^W-& (#ft^to3 

cofJ^H «*tfB«AXtm*B±-e#«^Pxi:ia 

< 45 J: 5 l-^r^i-S r £ So 
[0 0 6 3] ^1X^x^/2 3 4^1 HjftA&rjqij 
»B^b#ii^ttlilLfct&^<0 3 2k7cffi«, Xtf*^ 
5/^2 3 2-e»«Lfcrt#P«)f!l-frK*-5v^r, 4#»jSP 
x0 3^MI (Xx, Yx, Zx) 2rSlj|irs o _blEO«t 

saMgiisffl^^Tt, w^jw&a me) (D 

^ffi*«ii:aatt*9igL*lT*ix5<o-c, sialic <fc 
o T SIS **t*SJp^i PoXtW*^ PxO 3 ^TcMgco 

[0064] ^77/158 T*fl LtSP^ 

• m^m^MW^m m?) (d^t- y?2 1 z^mfe 

T*fl ««A*#1 O^fl^^trotl^I^ 
fy/21 8 0fiJ^#^$tufc^) Jc<0**»^P 
x0 3Jk5cJffi«S:i([J([-r SO-C, ^7^15 8 cofij^ 
tt. M*tf»*^Px^3jfc5cffi«*5a|^$ixfcj&^^ 

ixfc^d^^^y^l 5 4{CM*9. •IfffiA^Srarttc 
fflf«A*#l 0^^#ffiLTV^SPp^{4^x^^ P l 5 4-^ 
7^/15 8SrjSfc9iS-r o 
[0 0 6 5] ^x^/^1 5 8co*"J^^#^^ixfc 

6 0^#tTL. jfe^SlH^ • WfRA 
J^««^aT*^$ttfeSm^PoX^4#mAPxcO 3 

A^J#1 O^fgL^LTVNSfeg ilt, 
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A (HI 2co^S#0S) (OM^ (*PBBJffi«) Srttlf-r 

[0 0 6 6] tk(0^ yy^ 1 6 ^T 1 y^l 6 0 

tfSx-Y^Wf 1 2<D*^ffirt£©L^LT^5a> : ga» 

♦JfeSixfclfr&^tt^^y^ 1 6 4^tL, %<d*t 

a«F*Ji:*HCS*TRAM2 2CicEtt-*-5 0 
[0 0 6 7] ftO^f^yi 6 v^ry^l 6 0 

M) 6 0-CttliH«|[Lfc*B«tt«OJft* 

HSWLfci: #fc:«$RA;fr#l O^r^^W 1 2co 

[0 0 6 8] Sfc, W*(i1t^Jffi«*miHl«||[Ufc4:# 

7 2^tL, fB*tt«Ojffi«S:Htfli!»*Lfct#^fe 

»LT^5fctf>co, ^w»»*{ij?f^lltelc«i-e*>9 (* 
#A^#i o^it^tt^^^ToTv^5P^^i^^^^ > l 6 

1 6 8^m=rirZ> 0 

[0069] ^mmmmxa, mt its 1 3 (a) *c 

Kj ^T^fi^LT. 7-f^/^12^/Tffi 

(113 (A) l: r.j -e*ftt«) ^^I^x-^ <b 
LT^»ie«LTV^o 013 (A) ic^-T^m 

mcomm^MftLxi^ 0 ^7 7^i6 8m giffio 



5o 

[0 0 7 0] ^Lt, ftCO^^y^l 7 Otii, Xy" y 
6 8T*mffiO|g7Fffig^-^A,T^5^^Lfc^y 

-f 1 2<o**ffi±ojt*^ttfcteB 

^/T^^5o -blEcO^-r ^^1 6 8. 1 7 0li*JSW 

[0 0 7 1 ] ^coj;9{-. *«A*#l OtfUU::*** 

5/ K©ifi*flr«jc:^ — y^Sr«*$*50-e. tt#A^ 
#1 0lC££^f£griS^tboVNTV^£ UTt, jf^ 

ffia^w^o^y 5/ KrticffiitLTv^siB^ y/u 

#^co^y * K^**fcfiy5^5ffi«lc«*£*t5o ^ 
or, 1f#A^#l 0icj:^ft^{igo^^o#{c^b 

1\ yyKo**ffi«o-5*e,o#sr»«i-ac t^r* 

*«A*#l 0lc»fp««r**.*^i:4rWJt1-«c: 
[0 0 7 2] ^7y^l7 2C0fl^f£^c 

®ret£co-e\ * — y^Sr^^-r^^fiacoaiSi: lt 
— y/u<Q***t&7j*i-5 0 m^j: 9 , mm&mmwi 

y-f 1 7 4 3 lCE«0*^»J»^filC#Jfc LT 

[0 0 7 3] ±iec0^x^^l 7 4(t 1f«A^#l 0 

&±(D&W)&&x&mLx\s^mmy&Lnft£ft, ^ 
(Dt£<Dm^&mz#—y/u%m7F& j &z><DX\ if$RA 

±weco j: 9 (^m^^fs^ffiei-^- y 

Btt<OlR|±S:#Ji:L, a«E^«*ffi«^e>3f***7-fe 
2/ h L7tffiBlc^7 — y/u**^$-fr-5 X olzLXhk 

[0 0 7 4] _b^Ufc^^ ^/^l 7 OJLte*?" yT'l 7 
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fccD^y^l 7 6 -ef*i#$RA2># 1 OiCi «9 * y y? 

o*s¥*«r*»-*^<»i(i*-fr5«if^ (mi 4 (a) # 

RL JUT mm^V y^] fci^) s XT***A;ti#l 
OdS#«r«^*^<5gmi$*5«ifP (0 14 (B) # 

KU r^ii^ y y?\ £v^) £^ y y^mi^t-r 
[0 0 7 5] ffijii^ y ytWift^'&m? y y?mmm 

ffrSrfiroTV^SRK *2|i^Poi:W«^Pxt^8EI«k 

(012*1) «:*» 9 5S L«* U ^7^17 61:^5 
l^T. ^IUiS»Lfc^Wlk tfl9lil»*Lfcffilltk <h^M 

■So ^ x ^ ^ 1 7 6 0fl^5)t^fci^i:ii, Mb 

1 7 6 <OfiJ^5^^ttfc^^^^ 
firU ffl^A^#l O^X^Xftfrflfc? y yfWjmz 

BBi-5«« (mi** y y^»ff«?©»*tt« y * 
y 3/*»fMsawi* y y^^ii^ y 

n*:* y y ?mm^mir%mm^m^xmfc<»ttm%: 

5ri#-e*S^ ^^^V^^ 0 ^^ 1 2to*7j*®± 

[0077] wix-fia^a^e— k, 77^^ 

«LS^— K*ffl*tT*i< 4r*Kl. tf *A*t 1 0 
tf)^e— KSJ#*B*#& (7^/^^s'f■C^)o•ctJ;v^ 

a) r-fcoturt ^ y y^m^m=xt>Mz 

[0 0 7 8] **5, fflf«A^J#l 0jMR*T*>LTV^5 



i 2 <Dm^^<Dmm(D{iLm^mL^irrz^\cm 

»f^4:tT9Ci:Sr%x.Tfc, JWSrfttf Lfc**BB«r±«:f 

T\ ttf*A:rt#l OjMRSrJttf ^ai^i^CSS^P 
««A;fi#l O^^Vx^W l 2 0*^ffil*9lcfB 

SrBM&t-sav Av^ttflmffi-attiti 4ic*M-5* y s> 

l 2 5)S*B rt^fc L 1 1 # l:, * 

[0 0 7 9] *fc. fit#A^#l OfcJcS^ y y^iftff 
(DM * 4x5 pTUSttas fo 5 r £ S 
* y yf&Wt It, If^A^^-l 0^^ y ^^ii 

[0 0 8 0] ftic, **W<Offi©|tllfi»«Bi: LT, ffi^ 
fIJSff^ScD^{^100^!J{COV^-rlEj 1 5(D7P-ft-F^# 

BBU 5fel^ieif:fl^lWI (0 6) 

[0081] ^(Dmmj&mxiL mi 3 (a) i^^-r^ 

JyK ($51 (DP!) y K) Sr*ffitLt, ^V^^u-r 

1 2<Dm^%fcMmz&mm^ftmLtz£%(D, 

IftS^Sftf^SrfTorv^St t(cffl^5^2co^y 5/ K 
^f-^iLT, F^IT@13 (B) {c5S»-e^-t-J: 

K^^Of*M (013 (B) r.j T^-Tffi 
■) cOM^^^^ffi^tLTV^ < 6 0 ft*5, 013 (B) {C 

<o/^fl|«^ci^J^;urv^5 0 

[0 0 8 2] 015 ic^ihm^M^l-Cii. -tfffSA^ 

#1 otCct^^fis^^^^u^ 1 2(Dm^m±.% 

7^1 6 6, 1 7 2^*J*3&s#£S^fc^) {c^^ 
5/^1 7 3-#^L, aft©*S«tt«©Jffi*«rJB2©^ 
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lcffi«LT^£ Ca^ix-O^) /^ffl^So 
[0 0 8 3] ^Lt, ZfcCD^yXl 7 5T'fi s ^t 1 ^ 

xi 7 3x^^(om^iiLm^A,x^^ tn^^tc^v 

y K (fB*«4lc|B*o«F^/h««^»jcE) ^<fr*{£B 
(m 1 3 (B) {c r . j -e^-rfia) #-y 

[0 0 8 4] ilBO^ryXl 7 3. 1 7 5(1 ttiA 
0lc££^j£B^irV;*XW 1 2(£>*^®_h 

SriViW:»» UxryX^ft) t5-i:{c45 0 L 

a>u S2^^y ^ m*i oxy ^ k± 9 fc/hBat* 

*>9, f^f^^W 1 2©$*iBi D*Sfi©^5 y 
KfcSMHStt, mv&oy*V y K©t &ffi«oiBIH>/h 

t5rii:^5 0 tot, »*ffi«Sr»»S*S»f^* 

rir^tt^ 7 1 7 5 li 

[0 0 8 5] fe*3, ±lE^tt**Wlc«34#J£«*i: L 
TcDXy y Ko**ft«ic;fr~y/u***£-frTV^ 

(N^3) ■CfcoTfc.fcl^U «n4r*tpn»i L-C 

L T v x 5 tt]9f d s IB# S ttfcii^tc fll * tf 

[0 0 8 6] ±ET1i2^(OtT^^7 3 6 

A, 3 6 BSrRJtfcWSrRMLfcjftS, c:tt}cps^^tb5 
t>0>t?tt*< . J: O^ft^ifT 5 ^^ 7i:J:ot)lWIA 

[0 0 8 7] Sfc. ±E"Ctt**MJC«S4«F«^Pxi: 



[0 0 8 8] JElc, ttf*A*># 1 0 ©$^s, Jg53r_btf 
TV^:Rffi (Ell 1 (B) 3m (C) #fig) ^f>, $53: 
T5lfc*« (Ell 1 (A) |c»tbfc»*lc, 

A^/# 1 0 or&s&es-r 6 r t & 0 

[0 0 8 9] *fc % ±|5TM:* y y?W}ftk It, flftR 

y^»f^xtt*ii^ y y y-mft* 2mmnxn 

X\Xmx%Z>) ^KJy^&KPy^lff (^yKW 

y^iE-m ^"jxtfmjii^ y y?m\^nmtL 
n»wnft->&m* y y^»fp*©— sionf^icj: oft 

[0 0 9 0] *fc % fV^^W 1 2<bLtll X^X 
-^7W*XW, CRT, 3t77^^r>f^yW^ 
JS&<^S^I£B*jSJBLTfc £<^U «S=^— ^*Sr 

Sr*-T 3 feWStlrfV^/W Jc^^-f 5 i 9 lc L 
rfc<tv\ ^ft^ic^, JitScoJ: pftTffi^-f 

?K A -V 5/ * ^ V ^ a 5 — 1/ V X $r f I J ffl L 7c 3 tc 

[0 0 9 1 ] Mic, ±|E-ett*»Mtc:«5l5««E#:i L 
TCD-ROM42 SrWlcftW Lfc^, 

^J;1S/^— Kr^y^F D^cof^^l^V CD-R 
[0 0 9 2] 

-r^ztxn^^ntzmm^mm^m^^x, bh#*# 
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[0093] tmm2tmcD%twiz. tmmi<omm\c 

[0 0 9 4] »**3|E*6<0*Mtt, »**2(0»W^ 
[0 0 9 5] i»#*4lE«<&35Wra:, W*g2<0«Wfc: 

[0 0 9 6] IS*^6lBScC0^P^{i N Rtt»*#2&S#j£ 

[El 1 ] ««A*SWojaffl**^«B^fc5 0 
[02] *301l»«ifcfll«^> K*V v^^f v^A^i 

[B 3 ] flSK^KcofiB^jgigi: * ^(DUm^ 



[0 5] «Hfjft4k«««lnMKJE««**i-7o-^ 

[0 7 ] • <Kf»^ffi«»fl[»3lortS**i-7 

[08] HR9HKHA, bco^*t • iB*]\ yz*f*%* 5 

[0 9 ] ««A*#0#«atf*B±0tt«0«»ft 

[0 10] (A) Jbm. (C) ttflMRAA#©»flF«>— 

[011] (A) l&}*??***?\z.±9lHk£ti1tm 
«A^*<0#**1--<*— S*B. (B) tt»*jS<OJffi* 

[0 12] ^t$RA^#^^u^LTV^^y ; >^^U-Y 
±<Dffi«<^J^£fftWt-5fcfctf\ (A) (±'WfRA^f^ 
IHJOWBB* (B) ttflWRA*ffilBo«ffiB'C*>a 0 

[0 13] (A) tt««A**as»*ffi««:#»3* 

&&zl£1rZ>tz.#>(DJfy y H\ (B) f20 1 5 tc^-fjg^ 

—z?mxfoz> 0 

[014] (A) &mmi? V y^Wlfts (B) te^iffi 

[015] m<Dm^nm&m<Dftm&*<ir'7u—^Jr 



1 0 


*«A*# 


1 2 




1 4 




2 0 




2 2 


^ > h n — 9 


3 6 




4 0 


CD-ROM K^-f y< 


4 2 


CD-ROM 
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